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ABSTRACT 


cons ider^nonl i near  programming  problems  with  stochastic  constraints. 

The  Lagrangian  corresponding  to  such  problems  has  a  stochastic  part,  which 
in  this  work  is  replaced  by  its  certainty  equivalent  (in  the  sense  of  expected 
utility  theory).  It  is  shown  that  the  deterministic  surrogate  problem  thus 
obtained,  contains  a  penalty  function  which  penalized  violation  of  the  con¬ 
straints  in  the  mean.  The  dual  problem  is  studied  (for  problems  with  sto¬ 
chastic  righthand  sides  in  the  constraints)  and  a  comprehensive  duality  theory 
is  developed  by  introducing  a  new  certainty  equivalent  concept,  which  possesses 
for  arbitrary  utility  functions,  some  of  the  properties  that  the  classical  cer¬ 
tainty  equivalent  retains  only  for  the  exponential  utility. 
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1.  INTRODUCTION 

Consider  the  non-linear  programming  problem 


(P)  inf  gQ(x) 

s.t  g^(x,b)<0  i  6  I  = 

n  k 

where  x  61  is  the  decision  vector;  b  €  IR  is  a  given  fixed 

n  n  k 

vector  of  parameters,  gQ:  IR  +  IR  and  g^ :  1R  *  IR  -*■  R  are  given 
real-valued  functions.  We  will  sometimes  use  also  the  vector  nota 
tion  g(x,b)  =  CgjCx.b) , . . . ,gm(x,b))T .  Let  the  feasible  set  be 
denoted  by: 


S  =  tx:  g^(Xjb)  <  0  Vi  £  I) 

A  fundamental  approach  to  solve  (P)  is  to  replace  it  by  an 
unconstrained  problem  of  the  form: 


inf{gQ(x)  >  P(x}} 


where  P(x)  is  a  penalty  function  prescribing  a  "high  cost"  for 
violation  of  the  constraints  (see  e.g.,  Fiacco  and  McCormick  [1968], 
Luenberger  [1973]]. 

An  ideal  penalty  function  for  problem  (P)  is: 


P(x) 


0  if  x  £  S 

+®  otherwise 


In  fact  such  a  penalty  is  implicitly  embedded  in  the  Lagrangian 
associated  with  problem  (P) : 

Lj, (x,y)  =  gQ(x)  +  yTg(x,b)  . 
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Indeed,  (P)  can  be  reformulated  as  a  saddle- function  problem: 


inf  sup  L,  (x,y)  (1) 

x€lRn  y*0 


which  is  clearly  equivalent  to  the  unconstrained  optimization  problem: 


where 


inf{g  (x)  +  P(x)} 
x 


P(x)  =  sup  y'g(x,b)  . 

y*0 


(2) 


(3) 


Since  the  supremum  is  equal  to  zero  if  x  £  S,  and  to  infinity  if 
x  £  S,  P(x) ,  as  defined  in  (3),  is  an  ideal  penalty  for  problem  (P)  . 


Assume  now,  and  henceforth  in  this  paper,  that  the  parameter  b 
is  a  random  vector,  with  known  distribution  function  F^,  and 
support  BCR.  Problem  (P)  will  be  now  referred  to  as  Stochastic 
Program  (SP)  .  The  penalty  function,  just  defined  in  (3),  is  now 
the  solution  of  a  (linear)  programming  problem  with  a  stochastic 
objective  function.  For  such  problems  the  classical  economic  theory 
approach  of  decision  under  uncertainty,  is  to  replace  the  stochastic 
objective  function  by  its  expected  utility  Eu  (y^g(x,b) ) ,  where  u 
is  a  Von- Neumann-Morgens tern  utility  function,  and  E  denotes  the 
expectation  operator  with  respect  to  b.  Adopting  this  approach  here, 
we  replace  the  stochastic  objective  function  yTg(x,b)  by  its 
certainty  equivalent  u*1Eu(yT g(x,b));  thus  replacing  the  penalty 
function  (3)  by: 

P  (x)  *  sup  u'1Eu(yTg(x,b)) 

y>.0 

where  u" *  is  the  inverse  of  u. 


W 
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The  use  of  u  ^Eu(*)  in  (4),  rather  than  Eu(*)>  is  appropriate 
since  in  (2)  we  must  add  terms  with  comparable  units  (not  $  +  utiles) . 
Using  the  u-penalty  (4)  in  problem  (2) ,  the  stochastic  program  (SP) 
is  thus  replaced  by  what  we  will  call  the  Certainty  Equivalent  Primal 
problem: 

(CE-P)  inftg  (x)  ♦  Pu(x)} 
x  0 

In  the  first  part  of  this  paper  we  study  problem  (CE-P)  and 
show  its  relevance  as  a  penalty  approach  to  treat  programming  problems 
with  nonlinear  stochastic  constraints.  A  related  approach  for  the 
case  of  Stochastic  Linear  programs  is  given  in  Ben-Tal  and  Teboulle 
[1984].  The  study  of  (CE-P)  relies  on  the  properties  of  the  u-penalty 
Pu(x) ,  and  these  will  be  derived  in  §4  using  preliminary  results 
from  the  two  preceding  sections:  Section  2,  which  summarizes  some 
basic  facts  from  utility  theory,  and  Section  3,  in  which  we  prove  a 
convexity  result  on  the  certainty  equivalent  functional: 

v(y)  =  u_1Eu(yTZ)  . 

The  latter  result  is  needed  to  demonstrate  that  Pu,  given  in  (4) ,  is 
the  optimal  value  of  a  concave  program. 

In  the  deterministic  case,  the  representation  of  (P)  as  the  saddle 
function  problem  (1),  is  also  the  source  of  obtaining  a  dual  problem 
associated  with  (P) ,  namely: 

(D)  sup  infL.  (x,y)  . 

y*0  x 

In  the  stochastic  case,  it  is  then  natural  to  study  the  nature  of 
the  dual  problem  corresponding  to  (CE-P) .  This  will  be  carried  out 
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in  the  second  part  of  the  paper  (  §  5-8)  for  the  important  special 
case  of  problems  with  stochastic  righthand  side: 

(SP-RHS)  inf{gQ(x):  g(x)  >  b}  . 

This  question  was  addressed  recently,  for  exponential  utilities,  in 
Ben-Tal  [1984] .  It  was  shown  there  that  the  dual  problem  of  (CE-P) 
consists  of  maximizing  the  certainty  equivalent  of  the  Lagrangian 
dual  function: 

My)  3  infLb(x,y)  , 
x 

i.e.,  the  dual  problem  is 

(CE-D)  max  u'1Eu(h.  (y))  . 

y*o  ° 

This  result  is  recovered  here  in  Section  S.  However,  for  arbitrary 
utilities,  such  a  duality  result  does  not  hold;  this  is  due  mainly 
to  the  non-additivity  of  the  certainty  equivalent  for  non-exponential 
utilities.  Therefore,  we  suggest,  in  Section  6  of  this  paper,  a  new 
type  of  a  certainty  equivalent  functional,  which  possesses,  for 
arbitrary  utilities,  many  of  the  properties  that  the  classical  certainty 
equivalent  possesses  only  for  exponential  utilities^.  The  appropriate¬ 
ness  of  the  new  certainty  equivalent  in  defining  a  corresponding 
u-penalty  function,  and  its  use  in  treating  stochastic  programs  is 
discussed  in  Section  7.  A  complete  duality  theory  for  (CE-P)  is 
then  obtained  in  Section  8. 


For  the  special  role  of  exponential  utility  in  economic  analysis 
see  e.g.,  Bamberg  and  Spremann  [1981]. 
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2.  SOME  PRELIMINARIES  ON  UTILITY  FUNCTIONS 

In  their  classical  work,  von-Neumann  and  Morgenstern  [1947]  have 
developed  a  set  of  axioms  concerning  preferences  over  probability 
distributions.  Under  these  axioms,  a  random  variable  X  is  preferred 
against  the  random  variable  Y  if  and  only  if  there  exists  a  real 
valued  function  u,  called  a  utility  function,  unique  up  to  a  monotone 
increasing  affine  transformation,  such  that  Eu(X)  >  Eu(Y) ,  where 
E  denotes  the  mathematical  expectation.  A  decision  maker  is  called 
risk  avsrter  if  E(X)  is  preferred  against  X  for  all  random  variables 
X,  i.e. , 

u[E(X) ]  >  £u[X] 

The  latter  is  the  Jensen  inequality  for  u(*),  and  therefore  equivalent 

to  the  concavity  of  the  utility  function  u.  Throughout  this  paper 

we  shall  deal  with  the  class  U  of  strictly  increasing  concave  utilities. 

Further,  denote  by  U^  the  class  of  strictly  increasing,  strictly 

concave;  k-times  continuously  differentiable  functions,  more  precisely: 

*  {u  €  :  u'  >0  and  u  strictly  concave} 

Uk  =  (u  £  C ^ :  u'  >  0  and  u"  <  0}  k  >  2  . 


Following  Pratt  [1964]  and  Arrow  [1971],  the  measure  of  local  risk 
aversion  at  the  point  t  €  ]R  for  u  6  U^,  is  defined  by: 


r(t) 


u"(t) 

u'(t) 


(5) 


Three  basic  properties  of  r(t)  for  u  €  U2  are  summarized  below: 

a)  r(t)  is  well-defined  and  r(t)  >0  Vt  £  ]R  . 

b)  r(t)  is  invariant  with  respect  to  any  positive  affine  trans¬ 
formation  of  the  utility  function  u(t)  . 


c)  Given  r(t) ,  the  utility  function  u(t)  is  uniquely  determined 


(up  to  a  positive  affine  transformation)  by: 


u(t)  = 


exp  ( - 


r(o)do)  ds 


For  a  given  u  £  U,  the  inverse  function  u  exists  and  is 
a  strictly  increasing  convex  function.  The  Certainty  Equivalent 
of  a  random  variable  X  is  defined  by 


C(X)  =  u_1Eu(X) 


It  is  the  sure  amount  for  which  the  decision  maker  remains  indifferent 
to  a  gamble  yielding  X,  i.e.. 


u(C (X) )  =  Eu(X)  . 

The  following  properties  of  the  certainty  equivalent  are  immediate 
consequences  of  its  definition. 

Proposition  1  Let  X  be  a  random  variable  and  u  £  U  then: 

(a)  C(w)  s  w  Vw  £  R  . 

(b)  C(X)  is  invariant  to  affine  transformation  in  u. 

(c)  C(X)  <  E[X]  with  equality  for  all  X  if  and  only  if  u  is  linear. 

□ 

Looking  back  to  the  definition  of  the  u-penalty  function: 

P  (x)  *  sup{C(yTg(x,b))  =  u'1Eu[yTg(x,b) ] }  (4) 

y*0 

we  see  from  Proposition  1  that  it  possesses  two  desirable  features: 

(a)  In  the  case  where  b  is  a  deterministic  vector  of  parameters, 
the  original  problem  (P)  is  recovered  from  (CE-P)  ; 

(b)  The  penalty  function  is  invariant  to  affine  transformations  of  u. 


There  is,  however,  some  difficulty  associated  with  the  objective 
function  in  (4)  : 


Q(x;y)  =  C[yTg(x,b) ]  =  u_1E u  (yTg(x,b)) 

in  term  of  which  Pu  is  computed.  As  a  function  of  y,  Q(x;y)  is 

a  convex  increasing  transformation  (u of  the  concave  function 
T 

E u (y  g(x,b) ,  thus  in  general  it  is  not  guaranteed  that  Q(x;*)  is 
concave. 

In  the  next  section  we  characterized  the  utilities  for  which 
y  -»■  Q(x ; y)  is  a  concave  function,  for  any  random  vector  b.  The 
characterization  is  given  in  term  of  the  Arrow-Pratt  risk  aversion 
measure  r. 


3.  CONCAVITY  OF  THE  CERTAINTY  EQUIVALENCE  FUNCTIONAL 

Let  Z  be  a  random  vector  in  ]Rm,  and  for  u  £  U  define  the 
certainty  equivalence  functional  by 


v(y)  =  u_1E  u  (yTZ)  . 

X  m 

We  further  assume  that  Eu  (y  Z)  <  +«  Vy  £  IR  . 

Let  $  =  u  ^ ,  we  next  define  a  function  of  two  variables  h,  which  plays 
central  role  in  the  proof  of  the  main  result  of  this  section: 


♦  (x1)-<^(x2) 


h(xl , x2) :=  ^,(X2j 


Note  that  since  ■*.'  >  0,  hCx^x^l 
the  range  of  u  and  is  a  twice 
for  u  €  U^.  The  convexity  of 


is  well  defined  for  all  x^.x.,  in 
continuously  differentiable  function 
hCx^.x^)  will  be  now  characterized 


v '  w-;  v — T- 
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by  showing  that  its  Hessian  matrix  ^2h  is  positive  semi-definite, 
i.e.  , 

V  d  £  1R2  dTV2hd  >  0. 


Lemma  1  -  Let  u  £  0.,  then  the  function  hfx^jX^)  is  convex  if 
and  only  if  ^ry  is  concave. 


Proof:  The  Hessian  matrix  of  h  will  be  positive  semi-definite  if 
and  only  if: 


D(x,y)  :=  x^h^  +  y2h^2  +  2xyh^2  0  for  any  x,y  not  both  zero 


where  h. .  = 


32h 


ij  3x.3x. 
J  i  J 


i.j  =  1,2  . 


Computing  the  partial  derivatives  of  h(x^,X2)  we  obtain: 


hll  =  ’  (x_)  1  h12 


d>'  (x1)4>"(x2) 

$'2U2) 


r 

h22  =  4> 1  Cx2)  +  h(Xl,X2)\ 


.,1 


2*"*(x2)  (x2)4>'Cx2) 

V(x2)2 


Now  h^1  >  0  since  u  £  U2,  hence  D(x,y)  can  be  rewritten  as 

2 


D(x,/)  -hu  (x.^)2.(h22-^i),2  , 


and  is  non-negative  for  all  (x,y)  if  and  only  if  : 

h2, 

V*  h22  -  ir1  =•  0  ■ 


c<=> 


11 


In  terms  of  d(t),  the  risk  aversion  function  defined  in  (5)  is: 


r(t) 


- 1  ” 

[i  (t)]| 


1mm  A 


*  m  *  v  •*  *  *  ***»'*  *”  * 

Jk  ,\m  . . 
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By  the  inverse  function  theorem  we  have: 


u'  [<t> C t)  ]  =  '  ;  u-U(t)] 


u-U(t)]  =  3g2(t)  -  f'(tH'tt) 

ct'tt))5 

and  hence : 

r[4(t)1.  qa_  ,  ,h,t)l  .  *'wnt),:v;(t)  . 

+,2(t)  *,4(t) 

Now,  put  tj  =  Kx^)  and  1 2  =  $(x2);  computing  A^,  and  using  the 
fact  that  4>'  >  0,  we  obtain  after  some  algebraic  manipulations  that 
(6)  is  equivalent  to: 


r  (t2)  <r(t1)r(t2)  -  (t^t^rft^r '  (t2)  . 


Dividing  (7)  by  rCt^r  (t-,) ,  which  is  strictly  positive,  we  have  : 

1  1  r' 

?tV  (trV  7^7 

and  this  is  exactly  the  gradient  inequality  for  l/r(t),  which 
characterizes  its  concavity. 


Theorem  1 :  Let  u  £  U^,  then  the  function: 

v(y)  =  u_1Eu  (yTZ) 

is  concave  for  any  random  vector  Z,  if  and  only  if  - ^  is  concave. 
Proof : 

v(y)  is  concave  if  and  only  if  it  satisfies  the  gradient  inequality, 
i.e.,using  again  the  notation  <J>  =  u  ^  ,  and  observing  that  d1 '  >  0: 


-23- 


Clearly  then  ij> '  (p)  <  0,  i.e.,  ip  is  decreasing;  moreover  u'  >  0 
and  ct(p)  is  strictly  increasing  (the  composition  of  two  strictly 
decreasing  functions)  and  therefore  u'(p)  >  0.  and  thus  by  (21) 

'i>"  >  0  showing  that  is  strictly  convex. 

Finally,  since  u'(0)  =  1,  a(l)  =  0  and  thus: 


HI)  =  u(0)  =  0. 


□ 


Let  Z  be  a  random  vector  in  ]Rm  and  for  u  £  U..  we  define 

N 

now  the  New  Certainty  Equivalent  (NCE)  functional  by  w:  ]Rm  -*■  R 

w(y)  =  sup  (n  +  Eu (yTZ-n) )  .  (22) 

n  ER 

The  next  result  shows  that  w(y)  is  a  concave  function  for  any 
utility  function  u  £  (compare  with  Theorem  1,  5  3). 

Proposition  5  -  The  function  w:  Rm  -*■  ]R  defined  in  (22)  is  concave 

for  any  u  £  U  and  for  any  random  vector  Z. 

N 

Proof :  The  function  w  can  be  rewritten  as: 

w(y)  =  -  inf  F(n.y)  , 
n  €r 

where  F:  R  x  Rm  +  1R  is  defined  by  :  F(n,y)  =  -  n  -  Eufy^Z-n) 
since  u  is  concave,  it  is  easily  shown  that  F(n,y)  is  (jointly) 
convex,  hence  w(y)  is  concave  (see  Rockafeller  [1974],  Theorem  1) . 

□ 

We  shall  derive  now  an  explicit  form  for  w(y). 


Proposition  6  -  For  any  u  €  u,  , 


w(y)  =  n(y)  +  Eu(y  Z-”(yj 


(23) 


-22- 


we  get : 

M-Eu  (X-n)  >  (M-u(L-n))Pr{M-u(X-n)  >  M-u(L-n)}  .  (20) 

Since  u  is  strictly  increasing. 


Pr(M-u(X-n)  >  M-u(L-n)}  =  P(X  <  L)  =  p  ,  and  (20)  becomes 
n  +  Eu  (X-n)  ^  n  +  pu  (L-n)  +  M(l-p) 

thus 

S(X)  ^M(l-p)  +  sup  (n  +  pu(L-n)} 
n  E1R 

Differentiating  the  supremand  with  respect  to  q  and  equating  to  zero: 

u'  (L  -  n)  =  — — 

P 

This  equation  indeed  has  a  solution  n  for  all  0  <  p  <  1;  to  verify  this 

note  that  (u'(0)  -  1,  u'  is  decreasing,  and  assumption  A2>  imply 

Range  u'  3  [1,4-)  3  (y  1 ,  V  0  <  p  <  1. 

in  fact,  the  optimal  n  is 

n  =  L  -  (u* )  1  (— )  , 

P 

where  (u')  ^  denotes  the  inverse  of  u’ .  Inequality  (19)  thus  follows. 
Now  <[j(p)  can  be  written  as: 


<Kp)  *  M  -  p(M  -  u(a (p) ) )  -  a (p) 

with  a (p)  =  (u')  1(i)  ,  and  the  expression  for  its  derivative  is 

<|»'(p)  =  -  (M  -  u  (a  (p) ) )  +  a'(p)(pu'  (a(p))  -  1)  . 

Note  that  in  the  latter  the  second  term  is  zero  since  u'(a(p))  =  —  (  sc 


t'Cp)  -  -  (M  -  u(a  (p) ) ) 


*"(P) 


a' (p)u' (a (p) ) 


(21) 


The  next  result  gives  an  upper  bound  for  S(X),  which  will  be  useful  in 

proving  later  theorems  6,7,  and  8.  These  results  need  additional  assumptions 

on  the  utility  function  u:(a,b)-»-  ]R  (-00  ^  a  <  b  <  +<*>) 

Al.  u  is  bounded  above*. 

3  M:  u(t)  ^  M  V  t  €  (a,b) 

A2.^  ^  lim  u’(t)  =  +°° 
t-*-a 

Note  that  A2  holds  if  u  is  essentially  smooth  in  (a,b)  (see  e.g. 

Rockafeller  [1970]  pg.  251);  in  particular  it  holds  for  all  the  classical 

utilities  (log,  power  and  exponential  utilities).  We  denote  the  class  of 

A 

utilities  u  €  satisfying  Al  and  A2  by  U^. 

A 

Lemma  2:  Let  u  €  U.,  and  let  L  >  x  .  .  Denote 

-  N  mm 

p  =  Pr  (X  <  L) 

then 

S(X)<Hp)+L  (19) 

where 

HP)  =  M(l-p)  +  pu((u‘)  _1(p-))  -  (u')'1^)  . 

Moreover  <|>  is  a  strictly  convex  decreasing  function  in  (0,1],  with 

HI)  =  0 

Proof:  Let  y(t)  =  M-u(t-n)  and  k  =  M-u(L-n).  Then,  since 

g 

u  e  UN  y(*)  5*  0  and  k  >  0.  Applying  the  general  Tchebychef 
Inequality  (see  e.g..  Mood  et  al.  [1974]): 

E(y(X))  >  k  Pr (y (X)  3*  k) 


(*)  We  acknowledge  here  the  contribution  of  the  anonymous  referee  in 
pointing  out  the  necessity  of  this  assumption. 
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Proof:  (a)  By  definition,  S(w)  3  sup  (n  +  u(w-r,)},  equating 

n  E]R 

the  derivative  of  the  supremand  to  zero  we  obtain  u'(w-n)  -  1, 
hence  since  u'(0)  =  1  and  u*  is  strictly  decreasing  the  supremum 
is  attained  at  n  =  w  and  its  value  is  then  S(w)  *  w. 

(b)  By  (17)  we  have: 

S(X)  »  sup  (n  +  Eu(X-n))  <  sup  (n  +  E(X-n))  =  E(X) 
n  ER  nER 

(c)  For  any  nER  we  have  X-n  >  x  .  -n,  then  the  result  follows 
from  (a) . 

(d)  By  definition 

S(X+w)  =  sup  (n  +  Eu(X+w-n)  , 
nER 

hence  with  n  =  n-w,  one  obtains: 

S(X+w)  ■  sup  (n+w+Eu(X-n) )  =  w  +  S(X). 
nER 

(e)  Let  u(t)  *  l-e-t  be  a  normalized  utility  function,  then 

S(X)  =  sup  (n+l-Ee"^X"n^ } ,  which  by  simple  calculus 
nER 

_Y 

gives  S(X)  =-logEe  .  On  the  other  hand,  since  u  e  UN, 
u  *  exists  and  a  little  algebra  shows  that  C(X)  ■  u  ^Eu(X)  * 

*  -logEe  hence  for  exponential  utility  C(X)  *  S(X) . 

□ 

Example:  Let  X  be  a  random  variable  with  X_  <1.  Then  for  the 
r  max 

2 

(normalized)  quadratic  utility  u(t)  -  t  -  t  /t  ,  (t  <  1)  a  direct  com¬ 
putation  of  (18)  yields: 

S(X)  =  u  -  I  o2 

where  u  is  the  mean  of  X,  and  o2  its  variance.  For  this  case 
the  classical  certainty  equivalent  is 

C(X)  =  1  -  /(m-1) 2  ♦  o2 


□ 


-19- 


Therefore,  the  new  certainty  equivalent  can  be  viewed  as  an  integra¬ 
tion  of  the  expected  utility  principle  and  the  two  stage  approach 
For  the  latter,  see  Dantzig  [1955],  Dantzig  and  Madansky  [1961], 

Walkup  and  Wets  [1967],  Mangasarian  and  Rosen  [1964]  and  the  recent 
surveys  of  Dempster  [1980],  Kail  [1982]  and  Wets  [1983]. 

In  the  sequel  we  frequently  interchange  integration  and  differ¬ 
entiation,  e.g.:  -r—  Eu(t+X)  =  E  u(t+X)  .  For  this  to  hold  it 

dt  dt 

suffices  to  assume  that  u’(.)  is  continuous  and  Eu'(.)  <  00  .  See 
Bourbaki  [1958],  pg.  99. 

Let  the  support  of  the  random  variable  X  be  [x  .  ,x  ] . 

min  m&x 

The  supremum  in  (18)  is  attained  at  the  point  n*  satisfying 

Eu'(X-n*)  3  1,  and  since  u'  is  decreasing  then:  u'(x  -q*) 

max 

and  1  <  u' (xmin“n*^ *  hence  together  with  u'(0)  3  1  this  shows 
that  n*  £  [x  .  ,x  ].  Iu  particular,  for  random  variables  with 
compact  support,  the  supremum  in  (18)  is  attained.  The  appropriateness 
of  S(X)  as  a  certainty  equivalent  measure  is  further  supported  by 
its  basic  properties  which  are  collected  below. 


Theorem  4  -  For  any  utility  function  u  £  U^,  a  random  variable 
X  and  a  constant  w: 

(a)  [Constancy]  S(w)  =  w. 

(b)  [Risk  aversion]  S(X)  <  E(X)  ,¥  nondegenerate  random  variables  X. 

(c)  [Lower  bound]  If  X  is  bounded  below  by  x  .  then 


(d) 

(e) 


[Additivity]  S(X+w)  *  S(X)  +  w 

[Exponential-case]  For  the  (Normalized)  exponential  utility 
function,  the  new  certainty  equivalent  coincides  with  the 
classical,  i.e., 

S(X)  =  C(X). 
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Throughout  the  rest  of  this  paper  we  will  consider  the  class 
Uv,  of  normalized  utilities: 

u  euN  =  (u  £  U2:  u(Q)  =  0,  u'(0)  =  1}  . 

Note  that  for  every  u  E  U^: 

u(x)  >0  for  x  >  0  since  u  is  increasing  (16) 

u(x)  <  x  for  all  x  +  0  since  u  is  strictly  (17) 

concave , 

thus  a  normalized  utility  can  be  interpreted  as  a  discount  function, 
and  hence,  the  "present  value"  of  a  future  (uncertain)  income  Y  is 
Eu(Y). 

Suppose  that  the  decision  maker,  expecting  a  future  (uncertain) 
income  of  X  dollars,  can  consume  part  of  X  at  present.  If  he 
chooses  to  consume  n  dollars,  the  resulting  present  value  of  X 
is  then  n+  Eu(X-n).  Thus  the  sure  (present)  value  of  X,  denoted 
S(X)  is  the  result  of  an  optimal  allocation  of  X  between  present 
and  future  consumption,  i.e., 

S(X)  =  sup  (n  ♦  Eu  (X-n)>  (18) 

n  €IR 

which  is  our  new  certainty  equivalent.  In  fact,  S(X)  can  be 
written  alternatively  as: 

S(X)  *  sup  (n  *  E  sup  (u(y) :  n  +  y<  X)> 
n  €IR  y 

and  thus  it  is  the  value  resulting  from  applying  a  two-stage  approach 
("here  and  now")  to  the  stochastic  program: 

sup  { n  :  n  <  X}  . 


-17- 


Ben-Tal  [1984].  In  particular,  for  the  important  special  case  of 
stochastic  rhs  programs,  we  recover  here  the  result  showing  that 
the  dual  problem  of  (CE-P)  is  equivalent  to  Expected  utility  maximiza¬ 
tion  of  the  classical  Lagrangian  dual  function  of  (SP) .  In  the 
rest  of  the  paper  we  aim  at  generalizing  this  duality  relation  for 
arbitrary  utilities.  For  this  purpose  we  introduce  in  the  next 
section,  a  new  type  of  certainty  equivalence. 


6.  THE  NEW  CERTAINTY  EQUIVALENT 

In  this  section  we  introduce  a  new-certainty  equivalent  in  terms 
of  which  a  new  u-penalty  n^(x)  is  constructed,  maintaining  similar 
properties  to  Pu(x) »  as  well  as  producing  duality  results  for  (RHS) 
programs  for  general  utilities.  The  penalty  properties  of  Pu(x) 
rely  essentially  on  the  following  basic  properties  of  C(.)  =  (see 
Proposition  1,  Section  2) 

(a)  C(w)  ■  w  V  constant  w 

(b)  C(X)  <  E(X)  for  any  random  variable  X  and  u  £  U. 

On  the  other  hand  general  duality  results  for  the  (RHS)  case  rely  heavily 
on  the  additivity  property  of  C(*)>  (Proposition  4) 

(c)  C(X  +  w)  =  C(X)  +  w  V  fixed  w 

which  is  valid,  for  arbitrary  random  variable  X,  only  for  exponential 
utilities . 

The  three  properties  (a) -(c)  will  serve  as  guidelines  to  define 
our  new  certainty  equivalent. 


deterministic  primal  (C E-P)  is: 


m  v 

inf  (g0(x)  +  p  l  P*(x)}  . 

x  k=l 

Proof:  The  result  follows  immediately  from  the  fact  that  in  the 
case  of  exponential  utility,  the  certainty  equivalent  in  terms  of 
which  Pu  is  defined,  is  additive  (see  Bamberg  and  Spremann  [1981], 
Theorem  4) . 

□ 

The  certainty  equivalent  Cq  defined  in  (12)  has  the  following 
property  of  additivity: 

Proposition  4:  Let  u  be  an  exponential  utility  function,  then 
for  any  constant  w  £  R  and  any  random  variable  X 


Ca(X  +  w)  *  Ca(X)  ♦  w  . 


□ 


Consider  now  the  saddle  function: 

K(x,y)  =  gQ(x)  -  |  log  Ee“ay  g(x’b) 

Using  the  u-penalty,  given  in  (13) ,  we  see  that  the  deterministic 
primal  (CE-P)  becomes  for  exponential  utility 

(CE-P)  inf  sup  K(x,y)  (14) 

x  y*0 

Recalling  the  definition  of  the  Lagrangian  L^(x,y)  for  the  original 
problem  (SP) ,  and  using  Proposition  4,  (14)  is  easily  shown  to  be: 

(CE-P)  inf  sup  u-1Eu  ^(x.y)  (15) 

x  y?0 


The  u-penalty  (13) for  an  exponential  utility,  and  the  resulting 
min-max  representation  (15)  of  (CE-P) ,  were  studied  recently  by 


gives  the  following  nonsjnooth  optimization  problem: 


CAP) 


inf  {gQ(x) 


2r 


m 

l 

i=l 


o?(x) 


[max(0,mi(x))]  } 


5.  THE  CASE  OF  EXPONENTIAL  UTILITY 


In  this  section  we  confine  attention  to  the  important  special 
class  of  constant  risk  aversion  utility  functions,  i.e.,  utilities 
with  r(t)  *  i  ®  o  >  0.  This  corresponds  exactly  (up  to  a  positive 
affine  transformation)  to  exponential  functions,  u(t)  =  -e_0lt. 

The  associated  certainty  equivalent,  for  a  random  X  is  then: 


ca(X)  -  -  log  Ee"aX  Va  >  0 


and  the  corresponding  u-penalty  function  is  given  by: 


Pu(x)  =  Ca(yTg(x,b)) 


(12) 


(13) 


The  next  result  shows  that  for  (SP)  with  independent  constraints  (see 
Section  4,  Definition  1),  the  joint  constraints  penalty  Pu(x) 
defined  in  (4)  is  additive ,  i.e.,  the  sum  of  the  penalties 
(Pu(x):  k  €  1}  for  individual  constraints. 

Theorem  3:  Let  u  be  an  exponential  utility  function 


u(t)  =  a  -  be 


(p  >  0,  b  >  0,  a  £F) 


For  independent  constraints,  Pu  is  given  by: 


k  'ykgk(x’V 

where  P  (x)  =  p  sup  {-logEe  }  and  then  the  corresponding 

yk*° 


Using  the  approximation  in  (CE-P) ,  one  obtains  an 


approximate  Problem  (AP) : 

(AP)  inf  (gQ(x)  +  Pu(x)}  . 
x 

This  representation  can  be  further  simplifed  for  uncorrelated  cons 
traints  and  in  particular  for  independent  constraints . 


Definition  1:  We  say  that  (g^x.b)  <0  i  6  I>  are  uncorrelated 
[independent]  constraints  if  the  components  (b^L^j  are  un* 
correlated  (independent]  random  variables  and  if  for  each  i,  the 
i-th  constraint  depends  only  on  b^,  i.e.,  k  *  m  and  g^Cx.b)  “  g^Cx.b^) 
Vi  €  I.  In  this  case  the  variance  covariance  matrix  is: 

[of  00  i  =  j 


Z. .(x) 

l  0  i  f  j 

where  o?(x)  is  the  variance  of  g^Cx.b^. 

The  second  order  approximation  of  the  u-penalty  reduces  to 

1 


m 


P  (x)  *  Sup  l  [y.m.Cx)  -  yroyfof00] 
u  y*0  i»l  .  1  ^ 


where  m^(x)  *  g^Cxjb^}.  The  latter  is  a  maximization  of  a 
separable  function,  which  can  be  carried  out  analytically,  to  obtain: 


Proposition  3:  For  (SP)  with  uncorrelated  constraints,  a  second 
order  approximation  of  P^(x)  is 

PUCX)  3  2r"  E  ~ —  [max(0  ,m.  (x) )  ]  2 

°  i-1  a? (x)  D 

Thus,  for  uncorrelated  constraints,  an  explicit  representation  of  (AP] 


If  we  define  the  u-penalty  for  the  k-th  constraint  in  the  natural 
way  as: 

P„(x)  =  sup  u_1Eu  CykEk(.s,b))  (11) 

V° 

we  get  the  following  monotonicity  property: 

1  2 

Proposition  2:  If  x  is  less  feasible  than  x  ,  for  the  k-th 

constraint,  then 

P^Cx1)  $  P*(x2}  . 

□ 

We  derive  now  quadratic  approximation  for  the  u-penalty  function 
Pu(x),  for  u  €  U2.  First  denote: 

m(x)  =  Eg(x,b) 

Z(x)  *  cov(g(x,b) )  . 

It  can  be  shown  by  direct  differentiation  of  the  certainty  equivalent 
functional 

v(y)  =  u_1Eu  (yT g(x,b)) 

that 

Vv(0)  =  ra(x) 

V2v(0)  =  -r0*E(x)  with  rQ:=  -  >  0  . 

Moreover,  we  know  that  v(0)  =  0,  hence  a  second  order  Taylor- 
expression  of  v(y)  in  (4)  yields  the  following  approximation  of  Pu(x) 

P  (x)  =  sup  {yTm(x)  -  i  r  yTE(x)y}. 
yiO 

Note  that,  since  E(x)  is  positive  semi-definite,  the  approximate 
u-penalty  Pu(x)  is  the  optimal  value  of  a  concave  quadratic  program 
with  only  nonnegativity  constraints. 


r  u  w  w  .  *  *  r- 


AA 

k'. 

& 

m 


rr:«'  >''H  "j  V"  y  ' <;-T  ■?r 
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i 

f\ 


i 


then  we  have  Q^(x,0)  «  0  and  using  the  chain  rule,  with  u  being  continuous: 


3/l 


Q(x 


,y J  s  Egk(x,b)  >  0 

K  =n  K 


rk  "  Jyk=0 
Hence,  there  exists  yk  >  0  such  that: 

A 

Qk(x,yk)  ^  Qk(x,o)  =  o  . 

Noting  that  P  (x)  =  sup  Q(x,y)  >  sup  Qv(x,y.  )  (10) 

u  0sy£R  0$yk€R  K  K 

and  using  the  previous  inequality,  it  follows  that  ?u(x)  >  0  which 
proves  the  second  part  of  (i) . 

(ii)  Let  §k(x)  >  0  for  some  k  £  I.  By  (10)  we  have 

P  (x)  >  sup  u_1Eu  (y.  g.  (x,b))  . 
yki0 

Since  u  is  increasing  and  0  <  gk(x)  <gk(x,b),  the  above  inequality 
implies  that 

P  (x)  >  sup  u‘1Eu(y,g.(x))  *  sup  y.g.(x) 
yk>0  K'k  yk>.0  k‘k 

and  hence  the  result  (ii)  follows. 

□ 

The  first  part  of  the  theorem  demonstrates  that  Pu(x)  is  a 

penalty  function  for  violation  of  the  constraints  in  the  mean.  The 

second  part  shows  that  Py  has  the  desirable  property  of  excluding 

solutions  which  are  not  feasible  in  (SP) ,  for  any  realization  of  b, 

since  for  those  P  (x)  ■  ®  . 

uv 

We  say  that  x^  is  less  feasible  than  x2,  for  the  k-th 


constraint,  if: 


gk(x1,b)  >  gk(x2,b) 


Vb  £  B  . 


Not 


e  that  for  stochastic  right  hand  side  constraints  8k(x)  >  bk, 


this  simply  means  gj^ Cx1)  <gk(x2) 


V-V-VA  ?  -••VA'A’-V-Y-  .'A  -'.- 


/  -t  v-:-. 


mi  \  .i  .1  Wlwm 
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4.  PROPERTIES  OF  THE  u- PENALTY 

In  this  section  we  derive  the  basic  properties  of  the  u-penalty 
P  ,  defined  in  the  introduction  (see  eq.  (4)),  discuss  the  appropriate¬ 
ness  of  using  it  for  programming  problems  with  stochastic  constraints, 
and  derive  an  approximate  simple  expression  for  its  computation. 


Theorem  2  For  any  u  6  l)^,  the  u-penalty  function 


P  (x)  =  sup  u_1Eu  (yTg(x,b)) 
y*0 


satisfies 

(i) 


P  (x)  * 


positive 


if  Eg(x,b)  <  0 
if  Eg(x,b)  ^  0 


(ii)  P  (x)  *  “  if  for  some  k  g.  (x)  »  inf  g.(x,b)  >  0 

b€B 

-1  T 

Proof:  (i)  Let  Q(x,y)  a  u  Eu  (y  g(x,b))  then 


P  (x)  =  sup  Q(x,y)  >  Q(x,0)  =  0 
y*0 

Since  u  €  Uj,  by  Jensen  inequality  (see  Proposition  1  (c)) 
Q(x,y)  <  yTEg(x,b) 


(9) 


with  equality  for  y  =  0,  and  so 


T 

Pu(x)  =  sup  Q(x,y)  <  sup  y  Eg(x.b) 
y20  y*0 

Now,  if  Eg(x,b)  <  0,  the  last  inequality  shows  that  P^(x)  <  0 
which  together  with  (9)  proves  the  first  part  of  (i) . 

Assume  now  that  for  some  k  £  I,  Eg^(x,b)  >  0. 

Qk (x,yk3  .=  Q(x,0, •  •  *yk> •  •  •  ,0)  =  u  Eu(ykgk(x,b))  . 


»E  u  CyTZ)  -  «Eu  (xTZ)  <  E  (_(r-*>7Z_\  .  Vx,y  €  Rn  and  Z.  (8) 
4'Eu(XTZ)  V(u(xTZ)V 


The  latter  is  equivalent  to  Jensen  inequality  for  hCt^.t^)  with 
t^  ■  u(y^Z)  and  t^  ”  u(x^Z),  x,y  €  Rn,  which  holds  for  all  Z  if 
and  only  if  h  is  convex.  Thus,  invoking  lemma  1,  the  proof  is 
completed . 

a 


Remark  1  -  The  two  parameters  class  of  utility  function  with 
hyperbolic  absolute  risk  aversion  (HARA)  defined  by  r(t)  *  ^  , 

which  is  widley  used  in  economics  (see  e.g.,  Hammond  [1974],  Wilson 
[1968])  satisfies  trivially  the  condition  that  is  concave. 

The (HARA) family  consists  of  the  following  utilities  (defined 

for  t  >  -  —  ) : 

a  J 


u(t)  = 


•  log(b+t) 


if  a  =  0,  b  /  0 
if  a  =  1 
if  i^O,  a  i  1 


The  first  one,  corresponding  to  constant  risk  aversion  r(t)  * 
and  called  accordingly  (CRA) -utility  function,  is  of  particular 
interest  and  will  be  studied  in  Section  5. 


1 

F.* 


■  .vy  ’ y*  ** j."”  w"**^*-  / 


'  -  V-  j 


v- v%y v /  'Sv-*  ’ ^  "a/V 


where  n(>')  is  the  unique  solution  of  the  equation: 


Eu>  (yTZ-n(y))  =  1  ,  Vy  €  lRm  .  (24) 

Moreover 

(i)  n(y)  (and  hence  w(y))  is  continuously  differentiable; 

(ii)  n  (0)  =  w(0)  =  0;  7n(0)  =  Vw(0)  =  F.(Z)  . 

Proof :  Let  us  define  the  function  ij> :  !Rm  x  3R  -*•  1R  by: 

>(<Cy.n)  =  Eu'  (yTZ-n) 

Since  u  £  U  ,  ij/ (y,  n)  is  continuously  differentiable  on  ]Rm+*. 

Now  equation  (2^)  i.e.  4>(y.n)  =  l  has  a  solution  n  =  n(y)  for  arbitrary 
y.  This  follows  since  <j/(y,n)  is  continuous  in  n,  >Ky,n)  <  1  for  n  suf¬ 
ficiently  small  and  <Ky,n)  >  1  for  n  sufficiently  large.  Moreover  since 
3  T 

<Ky»n)  ■  -Eu''(y  Z-n)  >  0,  by  the  implicit  function  theorem  there  exist 
a  unique  differentiable  solution  n  *  n(y)  to  the  equation  'Ky,n)  =1.  Kv  t 
definition  of  w(y) ,  in  (22),  as  an  unconstrained  concave  optimization 
problem,  w(y)  is  obtained  by  equating  the  derivative  of  the  supremum 
to  zero,  thus  (23)  is  proved. 

Now  (24)  holds  for  any  y€  IRm,  thus  (0 ,n  (0) )  =  u'(-n(0))  =  1, 
then,  u'  being  strictly  decreasing  with  u'(0)  =  1 ,  we  get  n  (0)  =0 


and  hence  from  (23)  w(0)  =  0.  Differentiating  (24)  with  respect 

to  y,  gives  for  any  y  £  ]Rm: 

E((Z  -  Vn(y))u"(yTZ  -  n(y)))  =  0  . 

Then,  for  y  =  0,  using  the  facts  n(0)  =  0  and  u"(0)  <  0,  we 
have  Vn(0)  =  E(Z).  Finally,  differentiating  (23)  with  respect  to 
y  we  have  using  (24) : 


Vw(y)  =  E(Zu’ (yTZ  -  n(y)) 
and  thus  Vw(0)  =  E(Z). 


(25) 


□ 


7.  A  PENALTY  FUNCTION  INDUCED  BY  THE  NEW  CERTAINTY  EQUIVALENT 

In  analogy  to  the  way  the  u-penalty  was  constructed  in  terms 
of  the  classical  certainty  equivalent  (see  eq.  (4)),  the  new 
certainty  equivalent  induces  the  following  penalty  function: 

n  (x)  =  sup  S(yT g(x,b))=  sup  sup  (n  +  Eu(/g(x,b)  -  n)>  . 
y^O  y^O  n 

This  function  possesses  the  same  properties  as  P  ,  indeed  from 
Theorem  4  (a) ,  we  see  immediately  that  if  b  is  deterministic  then 


n  (x) 

uv  ' 


0  g(x ,b)  <  0 
+  “  otherwise 


thus  it  is  an  ideal  penalty  for  the  original  deterministic  program 
(P) :  inf{g  (x):  g(x,b)  <  0}  .  In  the  stochastic  case  it  can  be 
shown  in  analogy  with  Theorem  2  that  : 
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Theorem  5  -  The  function  ITU  satisfies  : 

'  0  if  Eg(x,b)  <  0 

nu(x)  =  •  positive  and  finite,  if  Eg(x,b)  0 

oo  if  for  some  k:  g^Cx)  >  0 

proof :  The  proof  follows  step  by  step  the  proof  of  Theorem  2  since 
the  latter  uses  properties  of  C(x)  which  are  shared  by  S(x), 
see  Theorem  4. 

□ 

Theorem  5  shows  that  is  a  penalty  function  for  violation 

of  constraints  in  the  mean,  and  it  automatically  excludes  solutions 
to  the  stochastic  program  (SP)  which  are  not  feasible  for  all 
realizations  of  b.  Therefore  a  suitable  deterministic  surrogate 
problem  for  (SP)  is: 

(NCE-P)  inf  (g  (x)  +  17  (x) }  . 
x  £]Rn 

From  the  additivity  of  the  new  certainty  equivalent  (Theorem  4  (d)): 

inf  { gQ (x)  +  n  Cx) >  =  inf  sup  S(g  (x)  +  yT g(x,b)) 
x  x  y30 

hence  (NCE-P)  can  be  written  as  a  minimax  problem  : 

(NCE-P)  inf  sup  S(L.(x,y)) 
x  yiO 

where  is  the  Lagrangian  of  problem  (SP) . 

We  now  derive  an  upper  bound  for  the  penalty  n  in  terms  of  the 
probability  of  satisfying  the  constraints:  Pr(g(x,b)  <  0). 

Theorem  6  -  Let  u  ^  .  For  every  x  such  that 

p (x)  ■  Pr(g(x,b)  <0}  >  0  ,  one  has: 


(27) 


nu(x)  <  v(p(x)) 

where  ^(p)  is  given  in  Lemma  2 . 

Proof:  Fix  x  such  that  p(x)  >  0.  Recall  that: 

T 

n  (x)  =  sup  S(y  g(x,b))  . 
y^O 

T 

Applying  Lemma  2  with  X  =  y  g(x,b)  for  some  non  zero  y>0,  and  L  =  0, 
we  get 

S(yTg(x,b))  <  <KPy)  (28) 

where  here  Py  =  Py(x)  =  Pr(yT g(x,b)  <  0)  .  Hence  from  (28) 

n  (x)  <sup  *(P  )  (29) 

y^O  y 

Moreover,  since  iji  is  decreasing  (see  Lemma  2)  : 

sup  <KP  )*  ♦(inf  Pr(yT g(x,b)  <0)).  (30) 

y^O  y  y*0 

T 

But  for  all  U  t  y  >  0:  Pr(y  g(x,b)  <  0)  >  Pr(g(x,b)  <  0) ,  and  hence, 
using  again  the  fact  that  'I'  is  decreasing, 

*(inf  Pr(yTg(x,b)  <  0) )  <i|/(Pr(g(x,b)  <  0) 

yiO 

which  combined  with  (29)  and  (30)  proves  the  inequality  (27)  . 

□ 

Remark  2 :  Using  the  properties  of  the  function  ^(»)  from  Lemma  2, 

it  is  interesting  to  note  that  the  larger  is  the  probability  of 
satisfying  the  constraints ,  the  smaller  is  the  "upper-bound  penalty" 
>J>(p(x))  . 

We  derive  now,  quadratic  approximation  for  the  penalty  function 

n  (x).  We  use  the  same  notations  as  given  in  Section  4.  Let  us 
u 

denote  by  wx(y)  the  NCE- functional  corresponding  to  the  random 
vector  Z  =  g(x,b).  From  the  Proposition  6,  for  u  £  ^  the  NCE 
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functional  is  given  by: 

wx(y)  =  nx(y)  +  Eu(yTg(x,b)  -  nx(y))  (23) 

T 

with  n  (y)  uniquely  determined  by  Eu'  (y  g(x,b)  -  n  (y))  =  1. 

X  X 

A  direct  differentiation  of  (23)  with  respect  to  y  gives: 
Vwx(0)  =  m(x) 

7^(0)  =  u"(0)E(x)  =  -  rQE(x) 

(since  here  u'(Q)  =  1,  rQ  =  -  =  -  u"(0)). 

Moreover,  we  know  that  wx(0)  »  0,  hence  a  second  order  Taylor 
expansion  of  w^(y)  is: 

wx(y)  *  yTm(x)  -  ~  tq  yTE(x)y 

and  therefore  an  approximation  of  n^(x)  is  given  as  the  optimal 
value  of  the  concave  quadratic  program: 

nu0c)  =  sup  (yT m(x)  -  j  r  yT E(x)y)  . 
y^O 

For  a  quadratic  utility,  the  approximation  is  exact;  this  can  be 
verified  by  a  direct  calculation.  The  approximation  n^(x), 
coincides  with  the  approximate  Pu(x)  of  the  u-penalty  given  in 
Section  4.  In  particular,  similar  results  concerning  uncorrelated 
constraints  (see  Proposition  3)  can  be  recovered  here,  i.e.: 

nu(x)  =  5^-  l  — - —  [max(0,m,  (x) )  ]  2  . 
u  *ro  i=l  o2(x)  1 
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8.  DUALITY  RESULTS  FOR  STOCHASTIC  RHS  PROGRAMS 

In  this  section  we  treat  the  special  case  of  the  general 
stochastic  programming  problem  (SP) : 

(SP-RHS)  inf(gQ(x):  g^x)  >  bi>  i  €  I  =  1, . . . ,m} 

which  is  simply  obtained  from  (SP)  with  g(x,b)  =  b-g(x). 

For  each  i  £1,  b.  will  denote  the  infinum  support  of 
Using  the  new  certainty  equivalent  S,  the  penalty  function 
is  given  here  by: 

n  (x)  =  sup  S(yT  (b-g(x)))  . 

yaO 

T 

However,  by  the  additivity  of  S,  since  y  g(x)  is  not  random, 
we  obtain  the  following  representation  for  nu  : 

n  (x)  =  sup  { w(y)  -  yT g(x)> 
y^O 

where  as  in  Section  6  : 

w(y)  =  S(yTb)  *  sup  (n  +  Eu  (yTb  -n)} 
n  €F 

The  corresponding  deterministic  primal  (NCE-P) :  inf  ( gQ(x) +nu(x) } 
is  then: 


(NCE-P)  inf  { gQ (x)  +  sup  (w(y)  -  yTg(x)}} 
x  y50 

Assume  from  now  on  that  gQ(x)  is  convex,  and  that  {gi(x))igI 
are  concave  functions,  so  (SP-RHS)  is  a  convex  program.  This 
implies  that  nu(x)  is  convex  and  so  (NCE-P)  is  a  convex  program. 
In  terms  of  the  saddle  function: 


(31) 


it  can  be  written  as: 


(NCE-P)  inf  sup  K(x,y) 

x  yaO 

We  define  the  Dual  problem  corresponding  to  (NCE-P)  by 

(NCE-D)  sup  inf  K(x,y)  . 

y*0  x 

The  main  result  concerning  the  dual  pair  (NCE-P)  and  (NCE-D)  is 
the  validity  of  a  strong  duality  result: 

inf  (NCE-P)  =  max  (NCE-D)  . 

This  will  be  proved  in  Theorem  8.  Before  we  need  an  additional 
limit  property  of  the  (one  dimensional)  NCE  function  w(y) ,  which 
is  interesting  by  itself.  A  similar  property  for  the  classical 
certainty  equivalent  functional  v(y) ,  but  only  for  the  exponential 
utility  is  given  in  Bamberg  and  Spremann  [1981]. 


Theorem  7  -  Let  X  be  a  random  variable,  with  x  .  >  -® 

-  min 

denoting  the  infimura  of  the  support  of  X,  and  let  u  £  l^,  Then 


. •  w(y) 
lim 

y-*-f<*>  7 


x  . 


mm 


(32) 


Proof :  We  have  to  prove  that 


lim  . 

(33) 

y  min 

• 

lim  <  x  .  *  e 

Y  min 

ye  >  0 

(34) 

y-++m 

For  any  y  >  0,  yX-n  >  y  x  .  -  n 

J  min 

and  since  u  is  increasing, 

from  the  definition  of  w(y)  we  get: 


w(y) 


sup  (n 

n  eiH 


♦  a  s(y  x„ 
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By  Theorem  4  (a),  S(y  x  .  )  =  y  x  .  ,  thus  'the  last  inequality 
proves  (33) . 

Let  e  >  0  be  fixed,  but  arbitrary.  Applying  Lemma  2  to  the 
random  variable  y X  with  L  =  y(x  .  +  e)  we  have  : 

w(y)  =  S(yX)  <  y(xmin  +  e)  +  ^ (p) 

where  p  =  Pr(X  <  x^n  +  e)  >  0.  From  the  latter  inequality,  (34) 
follows  immediately. 

□ 

The  duality  theorem  now  follows. 

Theorem  8  -  Let  (SP-RHS)  be  a  convex  stochastic  program  and  consider 
the  corresponding  deterministic  program  (NCE-P)  for  u  £  . 

If  the  following  condition  holds  : 

(S)  3x  €]Rn  such  that  g^(x)  >  vi  €  I 

then 

inf  (NCE-P)  =  max  (NCE-D)  (35) 

PToof :  Since  gQ(x)  is  convex  and  {g^(x)}^j  a*e  concave,  then 
K(*,y)  given  in  (31)  is  convex  for  every  y  >  0.  From  Proposition  5 
,  we  know  that  w(y)  is  concave,  hence  K(x,.)  is  concave.  By 
a  result  of  Rockafeller  [1964]  a  sufficient  condition  for  the 
validity  of  (35),  for  a  general  convex -concave  saddle  function  K(x,y)  is 

t  0  #yQ  >  0  such  that  yoVyK(x,y)  >0  (  x  €  ]Rn,  y  >  0) 

Here  by  Proposition  6,  (see  eq.  (25)): 

7y*U,y)  *  My)-g(x)  ■  E(bu'  (ytb  -  n(y)))  -  g(x) 


r-m  1*1.  nm wlm  * _ i.M  rlm.rCm 
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thus,  we  have  to  show  : 

$yQ  >  0  such  that  y^{E(bu'  (yTb  -  n(y)))  -  g(x) }  >  0 

Vx  €  Fm,  y  >  0  . 

This  is  certainly  satisfied  if: 

3x,  3y  >  0  such  that  vw(y)  =  E(bu' (yTb  -  n(y)))  <  g(x)  .  (36) 


and  then  by  Theorem  7 
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lim  w|(yi) 

V  .  -++<*> 

1  X 


**  lim 

y .  -*+® 
7 1 


Wi^i) 

*i 


which  is  exactly  (38),  and  the  proof  is  completed. 


□ 


Remark  3  -  The  regularity  condition  (S)  needed  to  establish  the 
strong  duality  result  for  the  pair  of  problems  (NCE-P)  (NCE-D)  is 
extremely  mild;  for  continuous  random  variables,  if  (S)  does  not 
hold,  then  the  feasible  set  (x:  g(x)  >  b)  is  empty  in  probability  1. 

□ 

Our  last  result  gives  a  concrete  interpretation  of  the  dual 

problem  (NCE-D).  Recall  that  in  the  deterministic  case  the  Lagrangian 

dual  of  (P)  is  the  concave  program:  sup  [inf  L,  (x,y)].  We  show  here, 

y*0  x 

in  the  stochastic  case,  that  the  dual  program  (NCE-D)  consists  of 


Theorem  9  -  Let  (SP-RHS)  be  a  convex  stochastic  program,  and 

u  C  UN  .  Then  the  induced  deterministic  dual  (NCE-D)  is  the  concave 

program: 

(NCE-D)  sup  S(inf  L.  (x,y))  (39) 

y*0  x 

Proof :  The  dual  problem  (NCE-D)  is  given  by 

(NCE-D)  sup  inf  K(x,y) 
y^O  x 

where  K(x,y)  is  defined  in  (3i).  Since  gQ(x)  -y  g(x)  is  not 
random,  by  the  additivity  property  of  S(*)»  (Theorem  4  (d))  K(x,y) 
can  be  rewritten  as  : 
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K(x,y)  =  S(Lb(x,y))  (40) 

T 

where  L^Cx.y)  =  gQ(x)  +  Y  (b  -  g(x))  is  the  Lagrangian  for  (SP-RHS) . 
Thus ,  in  order  to  prove  (39 ) ,  we  need  to  prove  that 

inf  S(Lb(x,b))  =  S(inf  I^Cx.y)) 
x  x 

Indeed,  we  have: 

S(inf  Lb(x,y))  *  S(yTb  +  inf (gQ(x)  -yTg(x))) 
x  x 

=  S(yTb)  +  inf (gQ(x)  -yTg(x))  [by  Theorem  4  (d)] 
x 

*  inf{S(yTb)  +  gQ(x)  -  yTg(x)} 
x 

=  inf  S(yTb  +  gQ(x)  -  yTg(x))  [by  Theorem  4  (d)] 
x 

-  inf  S(Lb(x,y)) 


□ 
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